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1 Artistic prototype 1: Stratigraphy 

The Stratigraphy prototype is an artist-led approach that aims to focus upon the structural narrative complexes 
of the LISTEN medium, promoting consideration of the temporal relativity of creative content, and its 
management in an agency-defined spatial environment. Inspired by archaeological recording methodology, it 
acts as a conceptual platform upon which to construct an agent-object hierarchy, and communicate the changing 
narrative potential of the LISTEN site. The following sections describe the basis of this approach, and the 
structural components developed for such an environment. 


1.1 Metaphorical Environment 

1.1.1 Archaeological Inspiration 


Derived from geology, strata in its simplest form means super-positioned layers, with the one [layer/strata] at 
the bottom generally understood to be the earliest in the sequence. Hence, the term ‘Stratigraphy’ refers to the 
methodology used to record the temporal relativity of deposits in archaeological excavations, with the aim to 
understand the past, through the representational metaphor of the archaeological record. 

To begin with an excavation of course happens at a certain site, but the part dug up is actually only a small, 
recorded area. Indeed, the whole archaeological site may comprise of many excavated areas. Also as it is only 
possible to excavate the ground once (the evidence is destroyed upon excavation!), detailed empirical data is a 
strong feature of modern archaeology, recording the spatial dimensions of each different layer / deposit / 
material encountered - it’s surface dimensions and depth. Within the deposit - or what will now be referred to as 
the ‘locus’ - may lay artefacts of interest and give clue to the usage or occupation of the site - essentially 
contributing to the historic or narrative of the site. 

Simplified, as the area is excavated, digging deeper, and based upon the stratigraphical law of super-position, 
the archaeologist records, diagrammatically, each locus and its relative relationships - before, contemporary, 
after, or no-relation - to other surrounding loci into a stratigraph of temporal relation, known as a Harris Matrix 
diagram. 



The resultant abstraction is illustrated by example above - the loci encountered first are positioned at the top, 
being the most recent deposits in history, and the lowest represents the earliest. Each locus is positioned 
according to its relative relationship to its neighbours. Hence the right-hand side of the diagram describes locus 
9 as the earliest (and first) unit in the stratigraphy, followed by 8, and later by 7 which is the temporal 
contemporary of 6, and so on, so that 1 and 2 are the most recent stratigraphic units, positioned above 3. 

On the basis of this relativity, via date analysis or cross-examination of found artefacts within the locus, the 
stratigraphic units illustrated in the Harris Matrix are divided into groupings or phases. These phases may 
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represent the interpretation of distinct structural development, activity use within the space, or periods of 
narrative history, depending upon the evidence present. Indeed, when the end of one phase, and the start of 
another, is identified, essentially an occupied surface is defined. 

In summary, the stratigraphical record is based upon spatial context, i.e. the definition of surface and interface 
between different contexts, forming a diagrammatic of temporally relative loci (with associated artefacts), 
organised into super-positioned strata and phases. 

1.1.2 Premise of application 

1. 1.2.1 Agency 

The application of such metaphor to immersive audio-augmented environments is gauged upon two premises: 

1. The interactor of a LISTEN environment occupies a dynamically changing soundscape, responsive 
to changes in the spatial movement of the user, and also occupies that space for duration of time. 

2. The narrative possibilities of agency - the interaction of the user within the space and the time 
spent in it - may be subdivided conceptually and defined as contexts, spatial-temporal. 

1.1. 2. 2 Locus 

The stratigraphical metaphor of the locus, with spatial dimensions - a location and an area - that has temporal 
relations with other loci, is determined to be a basic unit, representing a ‘field of agency’ and narrative potential. 

1.1.23 Artefacts 

The artefact associated to, or contained within, the contextual setting of the locus is related to the sound sources 
and events that exist within both spatial and temporal context in a LISTEN site. The sound content experienced 
by the LISTEN user, contributes to their’ own understanding of the environment and site. 

1.1.2. 4 Layers 

As there is no excavation in virtual space, therefore the association of depth relating to earlier periods of time 
cannot be applied. However the principle of divisible periods of occupation within the space can be 
conceptualized as successively changing 'overlays', representing relative narrative time - a consequential 
ordering of events - or continuous real time - the passage of seconds, minutes etc. 

1.2 Structural Environment 

To implement the metaphorical structure described in 3.1.1, it is necessary to reconstruct the spatial contexts and 
temporal categories of information recorded / experienced in an archaeological excavation, according to the 
premises described above. In other words, the content designer interprets the narrative potential of the LISTEN 
site into spatio-temporal contexts, locating the sound sources also into a combined spatial and temporal 
existence. These contexts and categories would then form the basis for modules of objected oriented code, 
which would allow narrative (sound) content to be defined as following: 

1.2.1 Container objects 

The stratigraphical environment, is an object-orientated hierarchy, constructed from a series of ‘container’ 
agents, mirroring the definitive categories within the archaeological excavation record: 
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The stratigraph 

consists of. . . phase/s (temporal/narrative modules) 

containing. . . area/s (which activates & constructs the relationships between loci) 

which contain. . . locus/loci (that have spatial dimensions, temporal relations) 
associated to. . . source/s (spatially-positioned sound events). 


1.2.1. 1 Stratigraph environment 

The approach used in the Stratigraph prototype was to create a specific stratigraph environment, as a child of the 
l-environment-class (in the example, st-test-environment-7-class.scm ), where all lesser-container objects are 
defined, bound to the l-environment of the LISTEN architecture. As the stratigraph object defines, and 
instantiates in completion, the phase objects, which contains a list of area objects, that contains a list of locus 
objects, and so on, the construction of the stratigraph is made on instantiation of the 1-environment. Due to the 
stratigraph environment being the highest container agent in the constructed hierarchy, the stratigraphic 
environment holds knowledge of which phase is currently active, on initialization, set to 0. With this knowledge 
it manages the initialization and change of phase/s, via an index system of reference, activating or deactivating 
the temporal/narrative models accordingly. 

1.2. 1.2 Container agents 

The following sections elaborate upon the function and role of the phase, area and locus objects. Each of these 
‘container’ objects are children of, and so inherit the properties of, the 1-agent-class. 

1.2. 1.2.1 st-locus-class 

The locus object is the key component of the stratigraphical environment. 

The locus, defined by it’s container object - an area - has relations with other loci dedicated as lists in the code 
structure - before, contemporary, after - and a stratum index, that indicates its temporal existence in sequence to 
the other loci in the area. 

As noted above it is deemed to be the unit or ‘field of agency’ for interaction with the environment, determined 
by spatial dimensions - instantiating both an l-zone-class and a graphical representation in the Avango world- 
model (in the basic case presented as a cube). Using a zone-callback the ‘field’ is activated or deactivated, 
although it may also be done so remotely. 

Each locus may allow a number of sources ‘attached’ to it, documented in the sources-within list. Upon 
activation, the locus instantiates a ‘personal’ permeability agent, (see 1.2.2. 1), which gathers the sound sources 
associated to the locus (and depending upon the permeability -values, those surrounding the locus spatially and 
temporally), activating them. Further, a looped (or non-looped) ambient sound, and event-triggers may also be 
linked with the locus, active for the period of the locus’ existence. 
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1.2. 1.2. 2 st-area-class 



The area agent constructs the actual relations between the list of loci-within, using 
the given definition of loci-relations, forming virtual strata or layers. Each locus in a 
particular layer - i.e. contemporarily relative loci that share the same period of 
existence - is allocated the same stratum-index. 

A model of the strata, illustrating the indexed, relative layers - before, after, 
contemporary - can, as in archaeology, be described as a stratigraphic matrix of the 
potential change of loci during the period of the phase (see left). 

Further it is the area that hold the knowledge of which stratum-index is currently 
active. Progression through the strata is implemented in this agent via an method that 
switches to the given stratum index, according to event-triggers associated with 
phase or loci agents, or in a direct-linear fashion according the phase agent’s 
schedule (see 1.2. 1.2.3). 


1.2. 1.2. 3 st-phase-class 

The phase object is the outer ‘bundle’ of area(s), and loci-within, that represents a narrative period or ‘greater’ 
temporal unit, ft is a segmentation of content that changes as a result of temporal, occupational change in the 
LISTEN site. The phase has a time scheduler (see 1.2. 2. 3) that can be primed with events and change. 
Likewise it may also contain event-triggers (see 1.2. 2. 2), which exist at the same location for the period that the 
phase is active. Hence, a phase can operate, exampled in the Stratigraph prototype, as either a ‘introduction’ 
chapter - awaiting independent of time for the trigger of the beginning of the narrative, as a temporally-primed 
period of time, that passes irrespective of the user’s interaction in the environment, or both. 

1.2.2 Agency objects 

The following agents are also based upon the 1-agent-class, however they operate outwith the container 
hierarchy: 

1.2.2. 1 st-perm-agent-class (permeabilty agent) 

Utilising the notion that a locus may be permeable 1 - allowing sound to pass into it - the permeability agent is 
set by configured indexes, either during the authoring process, or in response to occupation, so that upon 
activation the locus ‘gathers’ spatialised or ambient sound sources to play from surrounding loci, both spatially 
and temporally. For example, upon activation, a locus which is permeable with its contemporaries and relations 
previous, gathers sound sources from it’s contemporaries and it’s before-relations, that due to a scalar 
permeability-value of, say, 2, exist within a spatial field twice its own. Therefore, those gathered - the sound 
sources & samples associated to that locus - that ‘field of agency’ - are what can be heard when activated by the 
interactor. 


1 This quality of the locus continues the metaphorical association of the spatio-temporal unit of agency to that of 
the excavated archaeological stratigraphical deposit, usually some form of natural material such as soil, mud, 
stones etc.: A variable of context is its porous nature, and so may assist to determine how much the of contained 
objects or artefacts may have actually originated from surrounding stratigraphical deposits, for example, 
temporally after. 
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1.2.22 st-event-trigger-class 

To allow for agency-triggered change as a result of the LISTEN user interacting with the space, this agent 
utilises an 1-zone-class, of the fpLCylinderZone type, to monitor if the user activates a cylindrical trigger zone. 
If so, it triggers the event specified, using a generic instruction list of (agency operation subject value). For 
example: ("entered" "add" "stratum" 2) would instruct the event-trigger that when the trigger-zone is entered, 
the area (who, as seen above, manages strata change) increases the current stratum-index by 2, and so forward 
through the stratigraph. The event-trigger only exists according to the existence/active state of its associated 
container object. 

12.2.3 st-schedule-class 

The scheduler agent is based upon instantiating an 1-scheduler-class, and defining event functions, for example, 
add-strata, minus-strata, add-phase, reset-strata or reload-all scheduled events; functions which progress the 
temporal categories or indeed loop them. The event functions are lined up for execution, according the 
associated schedule list, to relative time periods (from activation of the phase) set within the phase object. 

12.3 Source/s 

The source, st-source-class, simply inherits the properties of the l-simple-actuator-class, drawing a sphere 
graphic representation at the given position in the Avango world-model. As an actuator it instantiates a monofile 
player and an ortf-source object, producing a simple spatialised source. The sound source fades in and out 
characteristically of the l-simple-actuator-class. 
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1.2.4 Structural summary 
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1.3 Conclusion 

The stratigraph environment prototype development, as documented in this section, follows a process from 
metaphorical inspiration, through cross-disciplinary analysis and application, to implementation as an object- 
oriented data- structure. It describes 

♦ Spatially defined loci (fields of agency) that the LISTEN user may be within, occupy, or be outside. 
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♦ Permeability agents, which activate/de-activate sound sources associated 9past, present or future) to the 
active locus, according to permeability values: spatial scalar among contemporaries and/or within strata 
before or after the currently active stratum. 

♦ An area agent which organises the loci to be temporally relative to each other in a particular phase of the 
stratigraphical environment, and structures them into layers or strata. 

♦ Loci units existing in a potentially changing state, as a result of user agency, activating an event-trigger, or 
due to the passage of time, nudged forward by a primed scheduler. 

Through these objects it is possible to successfully design a temporal matrix of narrative potential, which the 
LISTEN user may be contextually immersed among during the occupation of the site. And possibly more 
crucial, it provides a metaphorical language and terminology to describe these contexts. 

One of the most serious drawbacks to the stratigraph construction, however, is the lack of a dynamic allocation 
during runtime, not only of container components, such as loci or phases, but also sound sources. To elaborate, 
at the time of writing, and current stage of development, the structure is defined in its complete form in the st- 
test-environment-x-class. This approach certainly causes many runtime memory (and so performance) problems 
when the number of subdivisions in content spatially, temporally, is great, and hence uses many spatialised ortf- 
sound-sources (which are computationally ‘heavy’). 

Hence, due to the non-adaptive nature of the structure itself, plus its inherently segmented and discrete nature, 
the stratigraph prototype suggests itself as an add-on tool or metaphorical structure for spatio-temporal content 
design among some of the features of the other prototypes in this document, rather a solution alone. 
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